|
No. |
項目 |
百分比 |
說明 |
|
1. |
Final exam |
40% |
Dec. 20, 2023
20% of final exam scores will be for questions on selected midterm reports. |
2. |
Mid-term presentation |
10% |
Deadline: Nov. 1, 2023
1. Template of midterm reports in PPT is given by course website.
2. ONE main paper, must be a regular paper published in ACM/IEEE ICSE 2022-23, ACM FSE 2022-23, IEEE ASE 2022-23, ACM ISSTA 2022-23, ACM PLDI 2022-23, IEEE S&P 2022-23, ACM CCS 2022-2023, or USENIX Security 2022-2023.
3. No tool paper, no short paper, no affiliated workshop paper.
4. 2 comparison papers related to the main paper.
Comparing the three papers that you selected in the above.
5. Submission including your PPT file and MP4 Video for 10mins.
6. The report must be in English and is evaluated as follows.
20% on background before the work.
20% on the motivation.
20% Techniques of the work.
20% Experiment interpretation.
20% Writing. |
3. |
Project 1: White-box unit testing with CPP and coverage instrumentation |
15% |
Deadline: Oct. 18, 2023
1. Software under test (SUT) is a GitHub open-source CPP module/ SUT has been written by yourself / SUT has been modified from the example given by the TA
2. Must write assertions to evaluate the pass or fail of the test scripts.
3. Submission:
a) CPPUnit test modules, test reports, and SUT source code.
b) PPT explains the SUT, your test requirements, your test plan, and your test result with coverage analysis.
Your score is
(line coverage) x log2(#lines) (maximum: 7.5) +
1.5 x (bugs detected) (maximum: 7.5) +
1.5 x (bugs fixed) + no. of stars in GitHub + completeness of your report (0/1) (maximum: 7.5)
Maximum score: 15 |
4. |
Project 2: Web testing with Selenium |
15% |
Deadline: Nov. 22, 2023
1. A software under test (SUT) is a public website chosen by a student. No two students may choose the same website. FCFS (first-come-first-select) policy is used in tie-breaking. Registration form is here.
2. Must write assertions to evaluate the pass or fail of the test scripts.
3. Submission:
a) Selenium test scripts (.py), test reports
b) PPT explains the SUT, your test requirements, your test plan, and your test result. |
5. |
Project 3: RWD testing based on the AI API of Test-Dragon for cross-app and cross-platform GUI E2E testing |
20% |
Deadline: Dec. 27, 2023
1. Application under test (AUT) must be a mobile APP or a web program. No two students should use the same AuT. Please register your AUT to the TA by Nov. 29, 2023.
2. On the deadline date (Dec. 27, 2023) of project 3, we will have a deomonstration party. Please prepare your slides and run your xRWD in front of the class.
3. The reference source python program, xRWD.py, and materials can be found in https://www.test-dragon.com/TestDragon/helpTestDragon/helpTBots#ExampleFuzzerLab.
4. You must first log in to Test-Dragon to see the page in the above.
5. All students must send in their github account id so that we can invite them to xRWD github by Nov. 29, 2023. You can then raise issues in the repository.
6. The students are responsible for improving the functionality of four methods in class xRWD of xRWD.py.
oracle(), which files issue reports.
7. Submission:
a) Your improved fuzzer.py.
b) Specification of the AUT.
c) Issue reports generated by your fuzzer. |